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Abstract:In this paper, we first establish the reflected backward stochas- 
tic difference equations with flnite state (FS-RBSDEs for short). Then we 
explore the Existence and Uniqueness Theorem as well as the Comparison 
Theorem by "one step" method. The connections between FS-RBSDEs 
and optimal stopping time problems are investigated and we also show that 
the optimal stopping problems with multiple priors under Knightian uncer- 
tainty is a special case of our FS-RBSDEs. As a byproduct we develop the 
general theory of g-martingales in discrete time with flnite state including 
Doob-Mayer Decomposition Theorem and Optional Sampling Theorem. Fi- 
nally, we consider the pricing models of American Option in both complete 
and incomplete markets. 

Keywords: BSDE, RBSDE, Comparison Theorem, g-martingale, mul- 
tiple prior martingale, Knightian uncertainty. 



1 Introduction 

The theory of backward stochastic differential equations(BSDEs) was 
flrst introduced by Pardoux and Peng [T^. Over the past twenty years, 
BSDEs are widely used in mathematical flnance, stochastic control and 
other flelds. Some people had studied discrete time approximation and 
Monte Carlo simulation of BSDEs, such as Briand et al.[2]. Ma et al. [14j. 
Bouchard and Touzi [1] . By analogy with the theory of BSDEs, Cohen and 
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Elliott [8] considered the backward stochastic difference equations related 
to discrete time and finite state processes as entities in their own right, not 
as approximations to the continuous case. In their paper, they obtained 
the corresponding Existence and Uniqueness Theorem of the solution and 
Comparison Theorem as well as other interesting properties. For deeper 
discussion, the readers may refer to [6J and [7]. 

The general theory of reflected backward stochastic differential equations 
(RBSDEs for short) was studied by El Karoui et al. [9j. They considered 
the case where the solution is forced to stay above a given stochastic process 
(called the obstacle) and introduced an increasing process which pushes the 
solution to remain above the obstacle. This important theory could be ap- 
plied to the optimal stopping problem and some problems in finance markets 
[To] . So it is interesting to explore the reflected BSDEs in the framework 
of [8], as well as some applications in optimal stopping time problems in 
discrete time such as optimal stopping under Knightian uncertainty [2T], 
pricing of American contingent claims and so on. 

This paper is organized as follows. In section 2, the finite state reflected 
backward stochastic difference equations (FS-RBSDEs for short) are de- 
fined. We show that the Skorohod Lemma holds in this case. Moreover, 
the solution of the FS-RBSDEs corresponding to the value function of an 
optimal stopping time problem is proved. In section 3, we prove the cor- 
responding Comparison Theorem. It yields the Existence and Uniqueness 
Theorem through the Comparison Theorem in [8] in section 4. In section 5, 
we show the solution of the FS-RBSDEs where / is a concave (or convex) 
function is the value function of a mixed optimal stopping stochastic con- 
trol problem. In section 6, in order to study the optimal stopping problems 
in the framework of g-martingales, we first study the g-martingale, Doob- 
Mayer Decomposition Theorem and Optional Sampling Theorem, which 
were investigated in continuous time in [T7], [18] . We also give the con- 
nections between the FS-BSDEs and the multiple prior martingale under 
Knightian uncertainty. Consequently, the optimal stopping problem with 
multiple priors can be solved by computing a special kind of FS-RBSDEs. 
Finally we apply the above theory to study the pricing models of American 
option in complete and incomplete markets in section 7. 
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2 The Definition of FS-RBSDEs and the 



corresponding Skorohod Lemma 

As in [H], we will consider some under-lying discrete time, finite state 
process X which can be always assumed to be essentially bounded and take 
values in the stand basis vector of R"^, where m is the number of states of 
the process. That is, for each t E Af = {0, 1, 2, ...}, Xt G {ei, Cm}, where 
Cj = (0, 0..., 0, 1, 0, ...0)* G -R™, and (■)* denotes the vector transposition. 

Denote J-j is the completion of the cr— algebra generated by the process 
X up to time t. Then we consider this problem in a filtered probability 
space {Q, J-", {J-'t}o<t<T, P)- We assume that J-q is the trivial a— field and 
that J-" is the a— field generated by the union of all J-i, t G Af. 

Firstly let us introduce some useful notations. For each t,to,ti E Af = 
{0,1,2,...}, 

5*={ ^ is an J^^-adapted i?-valued r.v. and essentially bounded }; 
J^"'[to, h]={{^s, to < s < ti} is an J^5-adapted i?"-valued process and essen- 
tially bounded, n = 1,2, ...}. For abbreviation, we let £":=£"[0,T]. 

Define Mt := Xt - E[Xt \ J't-i] and Mq = 0. (Mt) is called the martin- 
gale difference process. Moreover, Xt is essentially bounded which deduces 
Mt is also essentially bounded. 

We then have a representation of the process X in the following form 

Xt = E[Xt I Tt-i] + MtE R^. 

The general form of backward stochastic difference equation was defined 
in [8], that is 

Yt = i+ Yl fiu,yu,Z^)- KMu+i, 0<t<T. (2.1) 

t<u<T t<u<T 

where T is a deterministic terminal time, ^ G iS^, Y is an i?-valued stochastic 
process, Z is an i?"*- valued stochastic process, the map / : ^2 x {0, 1, T} x 

From [8], we know that if / satisfies the following two assumptions: 
(.41) For any Y, if ^^ then F{uj,t,Yt,Zl) = F{u,t,Yt,Z^) P-a.s. 

for all t; 

{A2) For any Z, for all t, the map Yt ^ Yt — F{u,t,Yt, Zt) is a bijection 
from R to R P-a.s.. 
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Then for any ^ e «S^, the BSDE (2.1) has a solution {Yt, Zt). Moreover, 
this solution is unique up to indistinguishability for Y and ~m for Z. For 
reader's convenience, we recall the definition of Z^ r-^M Z"^- We write Z^ 
Z"^ if any case holds as follows: 

{%) ||Zi-Z2||2^ = 0, where 

\\Zf^ ■■ = ETr\ Z^ ■ ^[M„+iM„V|^„] • 

0<u<T 
0<M<T 

(M)i?Tr[(Zi-Z5M„+iM„V(Zi-Z2)*|J-„] = 0,forallwe{0,l,...,T-l}, 
{ill) ZlMu+x = ZlMu+i P-a.s. for all u G {0, 1, ...,T - 1}, 
(^^) Eo<«<*^n^n+i = Eo<n<*^'^n+i P-a.s. for all t6 {1,...,T}. 

Similarly we shall consider a FS-RBSDE based on M. It is necessary to 
introduce some assumptions in advance. 
Assumptions: 
{HI) i G S^- 

{H2) The map / : Q x {0, 1, ...,T} xRxBJ^ — > R satisfies that 

V(i/,z)Gi?xi?-, /(■,y,^)G£i; 
(iJ3) The "obstacle" {St-Q < t < T} is an -adapted real-valued 
process satisfying {Sf} is essentially bounded and St <^ P-a.s.. 

Definition 2.1. A triple {^, f, S) is called a standard data if it satisfies the 
above Assumptions ( HI )-( H3). 

Definition 2.2. A solution of our FS-RBSDE with terminal time T asso- 
ciated with standard data /, S) is a triple {{Y^, Z^, K^), < t < T} of J-t 
progressively adapted processes taking values in R x R^ x R satisfying 

(i) YteC\ZteC^,KTeS^- 

t < T; (2.2) 

{ill) Yt > St P-a.s., < t < T; 

{iv) {Kt} is increasing s.t. Kq — and 

J2 {Yt-St){Kt+,-Kt)^0. 

0<t<T 
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Intuitively, Kt+i — Kt represents the amount of "push upwards" that 
we add to — (Fi+i — Yt). Condition {iv) says the push is minimal, in the 
sense that we push only when the constraint is saturated, i.e. when Yt = St. 
Notice that in a deterministic and continuous framework, this corresponds 
to the Skorohod problem [20] • Now we shall consider the classical Skorohod 
problem under the discrete time and finite state framework. 

Lemma 2.3. Let y{t) be a real-valued function on {0, 1,...,T} such that 
y{0) > 0, there exists a unique pair of functions {v{t),g{t)) on {0, 1, ■■■,T} 
such that 

(i) v{t)=y{t)+g{t); 

(ii) v{t) is non-negative; 

(ill) g{t) is increasing, vanishing at zero and 

E v{t){g{t) - g{t ~ 1)) = 0. 

l<t<T 

The function g(t) is moreover given by 

g{t) = snp{-y{s)yO). 

s<t 

Proof. We first claim that the pair {g{t),v(t)) defined by 
g{t) = sup(-y(s) V 0), v{t) = y{t) + g{t). 

s<t 

satisfies properties (z) through {Hi). 

To prove the uniqueness of the pair {g{t),v{t)), we suppose that {g{ty, f (t)') 
is another pair which satisfies [i) through {Hi). Then v{t) — v{t)' = g{t) — 
g{t)' and note that g{Q) = g{Oy = 0, consequently f (0) — f (0)' = 0, so we 
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have 

{v{t) - v{t)'f = Ms) - v{sr - {v{s - 1) - v{s - 1)"] 

l<s<t 

= J2 Ms) - visY) + (vis - 1) - v{s - iy)][{g{s) - gisY) 



l<s<t 



{g{s - 1) - g{s - 1)')] 

E (^(^) - <')')Ms) - gis)') - {g{s - 1) - g{s - 1)')] 

l<s<t 
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+ E ^9{s - 1) - g{s - l)'){g{s) - g{s)') - E i9{s - 1) - g{s - 1) 

l<s<t l<s<t 

= - E <')^9{sy - g{s - 1)0 - E v{sng{s) - g{s - 1)) 

l<s<t l<s<t 

- E i9is - 1) - 9{s - If + E (9{s) - gisy)igis - 1) - g{s - 1)') 

l<s<t l<s<t 

< - E ^(')(9{s)' - g{s - 1)0 - E ^(^yiais) - g{s - 1)) 

l<s<t l<s<t 

_ j2 - 1) - gjs - ir ^ j2 i9{s)-9{sy\ 



l<s<t l<s<t 

By v{t) - v(ty = git) - gif)' , it follows that 
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< - E v{s){g{sy-g{s-iyy E v{sy{g{s)-g{s-l)) < 0. 



Hence v{t) = v{ty, consequently g{t) = git)' . □ 

Now our problem involves a discrete time and finite state Skorohod prob- 
lem, and we shall give some propositions. 

Proposition 2.4. Let {(Yt, Zt, Kt),0 < t < T} be a solution of the above 
FS-RBSDE mentioned in Definition 2.2. Then for each t e {0, 1, ...,T}, 

Kt-k,^ sup (e+ E fis,ys,Zs)- E KMs+i-S^)-. 

^-""-^ M<s<r U<S<T 

Proof. Set 

yt-^+ E f{s,Ys,Z,)- E Z:M,+,-ST-t. 

T-t<s<T T-t<s<T 



Then z/o = { - > 0. 

Notice that Yr-tiuj) — Sr-ti^j-') = Ut + Kt{oj) — KT-t{oj), so we know 
(FT-t('^) — 'S'T-t(w), Kt{u}) — Kr-tioj)), < t < T is the unique solution of 
the above Skorohod problem by applying Lemma 2.3, and 

- Xt-* = sup (e + z;m,+,-St-u)-. 

0<u<t T-u<s<T T-u<s<T 

The result then follows immediately. □ 

In the discrete time and finite state framework, we shall show that the 
solution Yt of the FS-RBSDE corresponds to the value of an optimal stop- 
ping time problem in the following proposition. 

Proposition 2.5. Let {{Yt, Z^, Kt),0 < t < T} be a solution of the above 
FS-RBSDE mentioned in Definition (2.2). Then for each t e {0, 1, T}, 

Yt = ess sup E[ Y Zs) + Sel{e<T} + il{e=T}\^t], 

t<s<e 

where J is the set of all stopping times dominated by T, and Jt — {0 & 
J;t<9<T}. 

Proof. Choosing a stopping time 9 e Jt, then from equation (2.2) we have 

Yt^Yg+ Y fiu,Y^,Zu) + K0-Kt- J2 Z:Mu+i, 0<t<T. 
t<u<e t<u<e 

taking the conditional expectation follows that 

Yt^E[Y0+ J2 f{u,Y^,Zu) + Ke-Kt\J^t] 
t<u<e 

>E[Y, /(^, Zu) + Sel{e<T} + ^l{e=T}\J't\. 
t<u<e 

In order to get the reversed inequality, we shall define 
Dt = mi{t <u<T;Y^ = S^} 
and Dt^T ifYu> Su,t <u <T. 
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Now the condition X]o<t<r(^t ~ St){Kf^i — Kt) — implies that 

= 0,^ + 1 <s< A- 

Then 

KD,-Kt= {Ks-Ks-i) = 0, 0<t<T. 

t+l<s<Dt 

Consequently we have 

t<u<Dt 



t<u<Dt 



< 



ess sup E[ Y /(^' ^u, Zu) + Sel{e<T} + ^l{e=T}\J^t\- 



t<u<e 



Then the result follows immediately. □ 

Remark 2.6. Denote Lt = 'Ylit<u<T Z*a^u+i- We consider the special case 
where f = C, St = ^ > 0, it follows from the above two propositions that 

Yo ^ + CT + Kt] 

= E[^ + sup{St + Lt- C{T -t)- 0+]. 
t 

Since St — then it is easy to check that 

Yo = sup E[Se] = E[ sup {St + Lt - C{T - t))]. 
e&jo o<t<T 

And when C—0, we get a special result that 

= sup E[Se] = E[ sup {St + h)]. 
eejo o<t<T 

3 Comparison Theorem 

Given Tt, let Qt denote the set of indices of possible values of Xt+i, i.e. 

Qt := {i : P{Xt+i = e, | Ji) > 0}. 

This set can be thought of as an J^t- adapted random variable. In the 
following context. 
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Theorem 3.1 (Comparison Theorem). Suppose we have two FS-RBSDEs 

associated with standard data {^^,f^,S^) and (^^, 5*^) respectively. Sup- 
pose {Y^, Z^, K^) and {Y^, Z^, K^) are associated solutions, and the follow- 
ing conditions also hold: 

(i) e > e, P-a.s.; 

(ii) f\uj, t, y/, Zf) > f(uj, t, Y-^, ZD P-a.s. for all times t e {0, 1, T}; 

(iii) S} > Si P-a.s.; 

(iY) f\uj,tX.Zl)-f\uj,tX.ZD>rnin,^Q,{{Zl-ZlY{e,-E[Xt^, \ 
Tt\)}, P-a.s. for all times t e {0, 1, ...,T}; 

(v) if Yl - f\uj, t, Y,\ Zl) > Y^ - f\u;, t, Y^ , Z\) P-a.s. for all times 
t e {0, 1, ...,T}, then Y^^ > Y^ P-a.s.. 

Then it is true that 

Yl>Y^ P-a.s.. 

Proof For t=T, it is clear that -Y^^ -^^>0 P-a.s.. 

For an arbitrary < t < T, suppose we know Y^^^ — Y^_^^ > P-a.s.. 
Then by (2.2), we have 

Y,'-Y,'-f\tX,Zl) + f\tX,ZDHZl-ZD*M,^,-iKl,-KD (3.1) 
+{Kl, - Kl) = Y,\, - Yl, > 0. 

Since Mt+i — Xt+i—E[Xt+i \ J-t], and we assume that Xt+i takes values 
in the basis vectors e^. So 

Yt' - Y,' - {Kl, - K]) + {Kl, - KD 

> fit, F/, Zl) - fit, Y^, ZD - mMZ] - ZD*ie, - E[X,+, \ Ft)]. 

Hence by assumptions iii) and iiv), we obtain 

Yt' - Y^ - fit, Y,\ Zl) + f\t, Yl Zl) - iKl, - Kl) + iKl, - 

> f\t, y/, ZD - fit, Y^, ZD + fit, Yl ZD - fit, Yf, zD 

- mmiiZl - ZD*ie, - E[Xt+, \ T^])} > 0. (3.2) 
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Since on {Y^^ < Yt^}, Sf < Si < Y^ < Y^, i.e. -Sf < Y^. Then 
K^^, - - 0, so 

Yt' - - fit, Y,\ Z\) + j\t, Yl Z]) > 0. 

Then by assumption (v), the above inequahty imphes 

r/>F/ P-a.s., 

which is a contradiction. 
So 

r/>r/ P-a.s. 

By backward induction, we know the statement is true. □ 

Remark 3.2. Note the assumption (v), if the map y — f{y,z) is strictly 
increasing in y, the theorem also holds. 

Corollary 3.3. Suppose {i\ f\ S) and (e^ /^ S) , {Y\ Z\ K^) and (F^ Z^, K^) 

satisfy the assumptions in Theorem 3.1, if we also know Y^ = Y^ , then 
Kj < P-a.s. for all t G {0, 1, ...,T}, and K] — is decreasing in t. 
Moreover, if we also have = i^,f^ = f^ P-a.s., then K] = P-a.s. for 
allt e {0, 1,...,T}. 

Proof. By inequality (3.2), we know 

Kl, - Kl < Kl, - Kl 

Then K} — is decreasing in t. 

More again, we know Kl — Kl — 0, So Kl < Kl P-a.s.. 
Because Kl — Kf is decreasing in we have 

K2 - Kl < Kl - Kl < 0. 

So 

Kl < Kl 

Then by induction we know Kl < K"^ P-a.s.. 

Moreover, if we also have = = P-a.s., then it is easy to see 

that K^ < Kl P-a.s.. Thus we have the result. □ 
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Remark 3.4. Under the assumptions of Corollary 3.3, if the notion > of 
any of the assumptions {{), (ii), (iv) in Theorem 3.1 becomes > , then Kj < 
a.s. for t G {0, 1, T}, and — Kf is strictly decreasing in t. In this 
case, by (3.2) we have Kf^^-Kf > K}^^-K} > 0, so there holds = Sf. 
Consequently we obtain S] = because ofY^ = Y"^ = S"^ < < Y^ . 

We now show a counterexample to state that Theorem 3.1 fails when 
one of Assumptions [iv) does not hold. 

Example 3.5. For simplicity, suppose T = 1. Consider a pair of FS- 
RBSDEs associated with standard data {C,^,f^,S^) and (^^, S*^) respec- 
tively which satisfy the Existence and Uniqueness Theorem 4-3 in the fol- 
lowing section. Moreover, let = f^ = f"^ = f and = S"^, then we 
have Yq = Yq, Kq = Kq and K\ = Kf P-a.s.. Suppose Assumption (iv) of 
Theorem 3.1 does not hold, particularly we have 

f{u, 0, Yl Zl) - f{u, 0, Yl Zl) < min,^Q,{{Zl - Zl)\e, - E\X^ \ 

Then we have 

= - Yl 

= Y^ - Y^ - /(O, zl) + /(O, Yl Zl) + {Zl - ZlYM, - {Kl - Kl) 
+ {Kl - Kl) 

> Y^ - Y^ - /(O, zl) + /(O, Yl Zl) - {Kl - Kl) + {Kl - Kl). 
It follows that 

= {K\ - Kl) - {Kl - Kl) > Y^ - Y^ - /(O, Y^, Zl) + /(O, Y^ Zl). 
Thus, we have Y^ < Yq, which is a contradiction. 



4 Existence and Uniqueness Theorem 

In this section, we will prove the Existence and Uniqueness Theorem 
of the solution of FS-RBSDE in which the map y — f{-,y,z) is strictly 
increasing and continuous in y, basing on approximation via penalization 
in [9] as well as the comparison theorem mentioned in [8]. 

Firstly, we recall the Comparison Theorem in [8] which is very useful for 
the following context. 
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Theorem 4.1. Suppose we have two discrete time and finite state BSDEs 
associated with standard data {^^,f^) and (^^,/^) respectively. Suppose 
{Y^, Z^) and (F^, Z^) are associated solutions, and the following conditions 
also hold: 

(i) e > e P-a.s.; 

(ii) f\uj, t, y/, Z^) > f(uj, t, Y,^ Z^), p-a.s. for all times t E {0, 1, T}; 

(iii) f\uj,t,YlZl)-f\co,t,Y,',Z^) >rntnieQA[ZhZ?riei-E[Xt+, \ 
J-t])} P-a.s. for all times t e {0, 1, ...,T}; 

(iv) ifY,' - f\u, t, Y,\ ZD > Y^ - f\uj, t, Y^, Z\) P-a.s. for all times 
t e {0,1,...,T}, then Y^ > Y'^ . 

Then it is true that 

Yl>Y^ P-a.s.. 

Corollary 4.2. Considering the BSDE (2.1), suppose (CS/^) o.nd {i^.f"^) 
, {Y^,ZD and {Y^,Z'^) satisfy the assumptions in theorem 4-1 , if we also 
know any strict inequality holds as follows : 

(i) e > e p-a.s., 

(ii) f\uj, t, Yt\ ZD > f\uj, t, ZD, P-a.s. for all times t e {0, 1, T}; 

(Hi) f\cu,t,Yt,ZD-f\co,t,Yt,ZD>mini^Q,{[Zl-Z^Y{e,-E[Xt+i \ 
Tt])} P-a.s. for all times t e {0, 1, ...,T}; 
Then it is true that 1^^ > 1^^ P-a.s.. 

Proof. By the above theorem, we have Y^ > Y^ P-a.s.. In this case, for a 
given by the same argument as used to (3.2), we obtain 

yl - Yt - fif F/, ZD + f% F/, ZD > 0. 

It follows that Y^^ ^ Y^ P-a.s.. Then we get the desired result. □ 

Theorem 4.3. (Existence and Uniqueness Theorem) Suppose we have a 
FS-RBSDE associated with standard data {C,f,S). Moreover the map f 

satisfies the following two assumptions : 

(i) for any Yt, if Z' Z\ then f{t,Yt,ZD = f{t,Yt,ZD P-a.s. for 
all times t G {0, 1, T}. 

(ii) The map y — /(•, y, z) is strictly increasing and continues in y. 
Then there exists a solution {{Yt, Zt, Kt) , < t < T} of FS-RBSDE 

with standard data {C,, /, S) and terminal time T. Moreover this solution is 
unique up to indistinguishability for Y and for Z. 
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Proof. If we know Yt = ^, we can begin with the time t = T — 1 and solve 
the one step FS-RBSDE to obtain Ir-i- Similarly, if we know Ir-i, then we 
can solve 1t-2 (if T > 2)hj one step method. Thus, piecing together all the 
one-step solutions, we can obtain the solution at any time t G {0, 1, ■■■,T}. 
Without loss loss of generahty, we only consider the following one step FS- 
RBSDE as follows: 

Yt = r^+i + fit, Yt, Zt) + i^i+i -Kt~ Z^Mt^,. (4.1) 

For each n = 1,2, define 

0<u<t 

Then fc" is increasing in n and = 0, /cJYi — k^ = n{Yt — St)^- 
(1) Existence We have divided the proof into two steps. In the first 
step, we shall construct a sequence backward stochastic difference equations 
and prove the corresponding solutions which converges to the solution of 
(4.1); in the second step, we shall prove the solution obtained in step (1) 
satisfies all the conditions of Definition 2.2. 

Step 1. Considering the following sequence of general backward stochas- 
tic difference equations : 

Y,- = Y,l, + f{t,Y,\Z^)+n{Y,^-St)--{Z^rM,^,, n e Z+ . (4.2) 

After taking conditional expectation for (4.2), we thus get 

Y,- = E[Yt+,\:Ft] + f{t,Yl',Z'^)+n{Y,--Str, n & Z+ . (4.3) 

Hence, 

{Z^yMt+, = Yt+^-E[Yt^,\J't]. 

By Martingale Representation Theorem in [12] , there exists a unique Zt 
up to equivalence ~Aft+i such that the above equation is satisfied for an 
arbitrary n. Using this Zt, (4.3) can be rewritten as follows: 

F," = Fi+i + fit, Yl\ Zt) + niXl^ -St)-- ZlMt+i, n e Z+. (4.4) 
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Let fnit,y,z) = f{t,y,z) + n{y - St) , then y - fn{t,y,z) is strictly 
increasing and continuous in y, hence it is also bijective. By theorem 4.1, 
(4.3) has a unique solution (F^", Zt). Clearly we have 

(0 fn+i{t, y, z) > fn{t, y, z) y{y, z) ; 

[ii) As = Zf+i = Zt, fit, Yt, Z-)-fit, Yt, Zf+i) = = min,eQ,{[^r- 
Z^'Yie, - E[Xt+^]}; 

(zu)As the map y — fn{t, y, z) is strictly increasing, we get the following 
truth: if 

yi - fn{t, yi, z)>y2- fn{t, 2/2, z), 

then yi > 2/2 P-a.s.. 

Therefor, by the Comparison Theorem 4.1 , we get that Y^~^^ > Y^ 
P-a.s.. Hence 

yn I p_ ^ ^ 



Moreover from (4.3), if > St, then F," = E[Yt+i\Tt\ + /(t,^",^^) 
which means Y^ is essentially bounded; on the other hand, if Y^ < St, 
then r" = Ei^t+ilJ't] ^ f{t,Yt",zn ^ j^j I means is essentially 

t n+l n+1 n+1 t J 

bounded. Thus, from Fatou's Lemma 



E\Yt\< lim E I Y^ |< 00. 

n— >oo 



On the other hand, by (4.3) we have 

Ktl - K+i \<\ fit. yi'^'\ Zt) - fit, Y^, Zt) I + I Y^^ - Y- I, Vp e M. 

Since / is continuous in y, and Y^ t P-a.s.. This gives 



Consequently there exists a adapted process i^t+i such that fcJYi ^ 
Kt^\, as n — > 00. Denote Kq — kg — 0, Vn e jV. 
Then let n — > 00, (4.4) becomes 

Yt = Yt+, + fit, Yt, Zt) + Kt+i -Kt- Z;Mt+i. 
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Step 2. It is easy to know that E \ Kt+i |< +00, so we can find a triple 
{Yt^Zt^Kt) which satisfies (i) and [ii) of Definition 2.2. It remains to check 
(m) and [iv). 

First of all, Kt is increasing as fc" is increasing and Kq — 0. As {Y^ — 
S,){k^^, - k^) = n{Y,- - St){Y,- - St)- = -n[{Y,- - St)']' < 0, then 

{Yt-St){Kt+,-Kt)<0. 

On the other hand, 

iY,-+'-sr<iY,--Sty. 

By (4.3) we also have 

(yn _ ^ Y- - E[Yt +,\Tt] - fit, Y-, Zt) 



n 



This clearly forces 



(r," - St)- i 0, {Yt - St)- = lim (r," - St)- = 0. 



It follows that Yt> St, hence 

{Yt-St){Kt+i-Kt)>0 P-a.s.. 



So we obtain [Yt — St){Kt^i — Kt) = P desired. 

(2) Uniqueness. At last, we shall prove the uniqueness of the solution 
obtained in step 1. Suppose there exist two different solutions (Fj, Zt, Kt) 
and (y/,Z;,X;) of FS-RBSDE (4.1). Without loss of generality, suppose 
Yt > y/. Then Yt > Yl > St, it follows that Kt+i - Kt ^ 0. Then (4.1) can 
be simplified to: 

Yt = Yt+i + fit, Yt, Zt) - Z^Mt+i. 



On the other hand. 



y; = Yt+, + fit, y;, z[) + K[^^ - K[ 



Z'*Mi 



t+1- 
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By theorem 4.1, we have Yt < Y"/ P-a.s., which is a contradiction. Simi- 
larly, the case Yt < Y^ is not true yet. So 1^ = F/ P-a.s.. 

More again, by the corollary (3.3), we have Kt = K^, Kt+i = -ft'f+i- 
Consequently we have 

z;*M,+i = z;m,+i = - E[Yt^,\Tt] + K^, - K - mUi - KlJ't] 

= Yt+i - E[Yt+i\Tt] + Kt+i -Kt- E[Kt+i - Kt\J^t]. 

Then by Martingale Representation Theorem, we have Zt ~a/ -^t • CH 

Remark 4.4. Note the assumption (ii) in Theorem 4-3, if the map f is 

decreasing and continuous in y, the theorem holds naturally. 

5 FS-RBSDE and optimal stopping time prob- 
lems 

In [9j, El.Karoui et al. shew that the solution {l^t, < t < T} oi 
the general reflected backward stochastic differential equation where / is 
a concave (or convex) function of (y, z) is the value function of a mixed 
optimal stopping stochastic control problem. In our framework, we also 
have these properties. At flrst, we show the solution of the FS-RBSDE 
where / is a given stochastic process is the value function of an optimal 
stopping time problem , then to the case where / is a linear function of 
(y, z). In the last case, / is a concave (or convex) function of (y, z), {Yt, < 
t < T} will be a value function of a mixture of an optimal stopping time 
problem and a classical optimal stochastic control problem. Note that we 
only should consider the above problems in "one step" FS-RBSDE because 
of the Existence and Uniqueness Theorem as well as the properties of the 
discrete time, i.e. 

Yt = Yt+i + fit, Yt, Zt) - Z;Mt+i + Kt+i -Kt,0<t<T. (5.1) 

Throughout this section, we maintain the Assumption {H4)'- if Z^ 
Z'^, it is true that Z^ = Z"^ P-a.s.. By proposition 2.5, we have the following 
properties without proof. 
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Proposition 5.1. Suppose that f & does not depend on {y,z); that is, 
it takes the form 

f{t,y,z) = at, 

where {at G £-'^;0 < t < T} takes values in R. Then the unique solution 
{{Yt,Zt,Kt),0 < t < T} of the FS-RBSDE (2.2) with the coefficient f 
satisfies 

Yt = ess sup + SeI{e<T} + iI{e=T}\^t]- 

t<s<e 

where Jt is defined in proposition 2. 5. Moreover, if we only consider (5.1) 
which can give 

Yt = Sty{at + E[Yt+,\:Ft]). 

Remark 5.2. Here is another way of stating the Proposition 5.1 using the 
Definition 2.2 directly. Denote pt = at + E[Yt-^-i\J-'t] which can be computed 
easily. After taking the conditional expectation for (5.1), we have Yt — 
Pt + E[Kt+i-Kt\:Ft]. 

If Pt> St, by (iv) of Definition 2.2, it follows that Kt+\ —Kt — 0. Then 
Yt = pt. 

On the other hand, if there holds pt = St, then Yt — St = E[Kt+i—Kt\J-'t]. 
More again by (iv) of Definition 2.2, it is true that Kt+i — Kt = 0. Thus, 
we have Yt = pt = St. 

At last, if Pt < St, it must hold that Kt+i — Kt > 0. Then by (iv) of 
Definition 2.2, we have Yt = St. 

To sum up, Yt^StV pt, i.e. = 5* V (a* + E[Yt+i\Tt]). 

Proposition 5.3. Under (HA), suppose f & be a linear function of 
{y, z); that is, it takes the form 

f{t, y, z) = at + (3ty+ < 7*, z >, 

where {at, Pt,lt,0 < t < T} are essentially bounded and progressively 
adapted process with in R x R x i?™ and f3t ^ ^ P-a.s.. Then a solu- 
tion {{Yt, Zt, Kt),0 <t <T} of the FS-RBSDE (5.1) with the coefficient f 
satisfies 

Yt^StV {at + PtYt+ < 7t, Zt > +E[Yt+^\Tt]), (5.2) 

where Zt satisfies that Z^Mt^i = Fj+i — £"[14+1 from the proof of Theo- 
rem 4-3. 
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Remark 5.4. Actually, after observing (5.2), we only need to solve the 
equation Yt = at + /3tYt+ < 7*, Zt > +E[Yt+i\Tt], i-e. (1 - f3t)Yt = < 
'yt, Zt > +-E[lt+i|J-t]. If the obtained solution Yt > St P-a.s., this solution 
is desired; otherwise, Yt = St P-a.s.. 

Remark 5.5. // there holds [it = 1 P-a.s., then we have y — f{t,y,z) = 
—at— < '~ft, Zt > which does not satisfy the assumption (ii) of the Existence 
and Uniqueness Theorem in f3], which leads that there does not exist a 
unique solution. So we limit that Pt ^ P-a.s.. 

We now suppose that for each fixed (Wjt), f{t,y,z) is a concave func- 
tion of {y,z). Define the conjugate function F{t,/3,'y) as follows. For each 
{to, t, /3, 7) e n X {0, l,...,T}x Rx R"', 

F{u, t, /3, 7) = sup(/(t, y, z) - I3y- < 7, z >) 

Df{uj) = {(/3,7) e Rx R""; F{u,t, (3, j)is essentially bounded}. 

It follows that f{t,y,z) = inf^^ ,^)g£,F{F(t, /3, 7) + f3y-\- < 7,2; >} and 
the infimum can be achieved at (/?', 7') G Df, the set Df is essentially 
bounded. We shall denote the unique solution {{Yf''^,Z^''^,K^''^);0 <t< 
T} and {{Yt, Zt, Kt);0 < t < T} of the FS-RBSDEs with the coefficient 
f^'^fit, y, z) = F{t, Pt, It) + Pty+ <lt,z> and f{t, y, z) respectively. Con- 
sequently we have 

f{t, Yt, Zt) = F{t, 13', 7') + l3'Yt+ <i,Zt> P- a.s., a.e.; 
{Yt, Zt, Kt) = {Yf^^', Zf Kf'^') P - a.s., 0<t<T. 

We can then deduce an interpretation of Yt = Yt ''^ as the value func- 
tions of optimization problems. 

Theorem 5.6. Under (H4), for each {(5f,lt) e Df and \(5t\ < 1 P-a.s.. We 

have 

F/'^ = Sty {F{t,(3t,it) + litYf'''+ <luZt> +E\Yt+i\Ft]) 
Yt = Sty{F{t,P[,i^)+[5tYt+<it,Zt>+E[Yt+i\7t]). 
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where Zt satisfies that Z^Mt+i — It+i — £'[1^+1 from the proof of Theo- 
rem 4-3. Moreover, 

Yt = ess inf Yf'^ 
(^,7)eDf 

= ess inf {Sty{F{t,Pt:lt) + PtYf'^+<lt:Zt>+E[Yt+i\J^t])) 
(/3>7)ei3f 

^StVess inf {F{t,Pt,7t)+PtYf'''+<^t,Zt>+E[Yt+,\J't]). 

In other words, Yt is the value function of a minimax control problem, 
and the triple (f3', 7', Dt), where Dt — mi{t < s < T;Ys — Ss} is optimal. 

Proof. The first part of the statement follows from Proposition 5.3. 
Moreover, from the Comparison Theorem 3.1, we have 

Yt<Yf'\ V(/3,7)eDf. 

On the other hand, 

Yt = Yf''^' > inf Yf'\ 

which immediately deduces 

Yt = ess inf F/'^. 

At last, it is easy to see that ess inf and V can be interchanged. □ 

Remcirk 5.7. If f is a convex function of {y,z), we only need replace 
ess inf (^^^)g^F ...V by ess sup(^^^)gof -V- 

Actually, there are many processes Xt satisfying the Assumption (H4), 
such as the random walk and basis vector. 

Example 5.8. Suppose Xt be a standard random walk, i.e. Xt = ^*=o^«' 
where {ej} is a stochastic oscillator sequence which is independent and can 
only be ± 1 with equal probability 1/2. As is known, Xt is a martingale. 
ThenMt^Xt-E[Xt\J't-i\^et. 

In this case, if r^u ZP' , i-e. Z^ei — Z'^e\, it is true that = 
P-a.s.. 
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6 g-Martingale Theory in discrete time and 
finite state space 

In this section, in order to study the optimal stopping problems in the 
framework of g-martingales in discrete time and finite state space, we first 
study the g-martingale, Doob-Mayer Decomposition Theorem and Optional 
Sampling Theorem, which were investigated in continuous time in [1], [13], 
[T7] and [IH]. We also explore the connections between minimum expecta- 
tion and g-expectation which is important for computing the multiple prior 
expected rewards of an agent. 

Riedel [21] has considered a theory of optimal stopping and multiple 
prior envelope when the expected payoff is evaluated by mip(zQE^[Xr]. 
Here, we give the connections between the FS-BSDEs and the multiple 
prior martingale under Knightian uncertainty. Consequently, the optimal 
stopping problem with multiple priors can be solved by computing a special 
kind of FS-RBSDEs to obtain the multiple prior envelope. 

Firstly, we should establish the theory of g-expectation and g-martingale 
in our framework. 

6.1 g-Expectations and g-Martingales 

Peng introduced the notions of g-expectations and conditional g- 
expectation as well as g-martingale via the general BSDEs, and he also 
proved a general nonlinear Doob-Mayer Decomposition Theorem for g- 
super- martingales in [12]. This section is aim to study the g-martingale 
and Doob-Mayer Decomposition Theorem in our framework. 

As in [17j, we give the following notion of "g-expectation" via BSDE 
(2.1). In the remainder of this section we also assume / satisfies 

/(0,0,t) = 0,Vt > 0. {A3) 



Definition 6.1. Given the finite time horizon T, for each C, G S'^ , suppose 
the map f satisfies the assumptions (Al)- (A3) and {Yt, Zt) is the solution 
of BSDE (2.1). We call Go^t{0 defined by Go,t(0 •= the g-expectation 
of the random variable ^ generated by function f . 

From the definition of g-expectation, we can define the conditional g- 
expectation as follows. 
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Theorem 6.2. Given the finite time horizon T, for each ^ e . Then 
there exists a rj G such that 

Go,t{IaO = Go,rMyA eTr;re {0,l,...,r}. 

Moreover, r) coincides with Yf— the value of the solution of BSDE (2.1) 
at time r. We then call r) the conditional g-expectation of ^ under J> in the 
time sequence {r,r+l, ...,T} and write it as Gr,T(0- Under the assumptions 
(iii) and (iv) of Theorem 4-i, 1] is unique. 

Proof Let {y,z) be the solution of BSDE (2.1). For VA e Tr, let {y,z) be 
the solution of the following BSDE: 

yt^CiA+ fi^^Vs^^s)- ^sMs+l. (6.1) 

t<s<T t<s<T 

Multiply 1a on both sides of BSDE (2.1) and then observe ytlA on 1^ + 
1, ...,T}. Note there exists the relation f{t, IaV, Iaz) = f{t,y,z)lA,^t > 
because of the assumption (^3). Immediately, by the uniqueness of the 
solution of BSDE (6.1), we have 

yslA = ys,^se{r,r + l,...,T}. (6.2) 



Define rj := y^, then rj & obviously. By the definition of Gq^t{^aO 
and from (6.2), we have 

Go,t{IaO = yo = Go,r{yr) ^ ^0,^ d/r-l^) = G'o,r(^lA)- 



It remains to prove rj is unique. Assume that there exists another f3 e 
such that for any yl e J>, 

Go,r{vU)^Go,rWlA). (6.3) 



But P{r] 7^ /3) > 0. We can choose A = {rj ^ /3}, then it follows from 
corollary 4.2 that Go,r(^lA) 7^ Go,r{PlA), which is contrary to (6.3). The 
proof is complete. □ 

Definition 6.3. Under the assumptions (iii) and (iv) of Theorem 4-1, a real 
valued adapted process {Ut} is called g-martingale(resp. super-martingale, 
sub-martingale ), if Ut G 5*, Vt, s G {0, 1, ...,T}, t < s, 

Gt,s{Us) = Utiresp. < Ut, > Ut)P - a.s.. 
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It is easy to check the following properties of G.^.{-) (see [1] for more 
details). 

Corollary 6.4. Any g-martingale {Ut} has the following basic properties: 

(1) For each < ti < t2 < t^ < T , Gt,^t,iUt,)=Gt„t,iGt,,tMs)); 

(2) (comparison theorem) IfU] < , then Gt^,{U}) < Gt,s{U^) forO<t< 
s<T; 

(3) For any A E 7t, = ^^^,,(1), < t < s < T; 

(J^) Let {Aj}"^^ C J-jo he a partition of Q, then for any G S'^ , i = 
1, 2, n, we have 

n n 

GtAj^^rUj = Y.Gt,T{Uir)lA.,,t G {to, to + 1, T}- 

i=l i=l 

To prove the Doob-Mayer Decomposition Theorem, we need show a 
general type of g-martingale Gs,t{,-',K) induced by Gs,t{-) for each given 
process K G P(0,t) which often represents a dividend or a consumption 
process in finance. Here 1^(0, t)={{(y9t, < t < T} is an J^^-predictable 
real- valued process and essentially bounded}. For convenience, we would 
consider stopping times < o" < r < T instead of deterministic times s and 
t. The corresponding backward stochastic difference equation becomes as 
follows: 

sAt<.u<t sAt<u<t 

(6.4) 

where X G S^, K G V{0,t). Then we have the following theorem: 

Theorem 6.5. For each given process K G V{0,t), assume assumptions 
( Al) -( A?)), there exists a unique solution {YJ'^'^ ^ Z'^'^'^), s G {0, 1, r} 
ofBSDE (6.4). 

Proof. Define 

/(s, y, z) := f{s, y - Ks, z)1{o,i,...,t}{s). 
Considering the following equivalent BSDE 

Z = X + Kr+ J2 RnX^Zu)- J2 Z:Mu+uO<s<T. (6.5) 

s<u<T s<u<T 
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It is clear that Yg = X + Ks, Zs = on {r, r + 1, T}. Since {X-\-Kr, f) 
satisfies the assumptions {Al) -{A3), then BSDE (6.4) has a unique solution 
{Y-K,Z). □ 

We denote G^,r{X;K) := YJ^^'^ and G',,,(X) := G^,^(X;0). Here we 
will introduce the notion of G{-; A)-martingale. 

Definition 6.6. Let K E V{0,t) be given. A process Y E C^[to,ti] is 
said to be a G{-; A) -martingale (resp. G{-; A)-super-martingale, G{-;A)- 
sub-martingale) on {to,^o + 1, if for each to < s <t <t\, we have 

Gs,t{Yu A) = Ysiresp. < F,, >Ys),P- a.s.. 

Theorem 6.7 (Doob-Mayer Decomposition Theorem). Let U be a g-super- 
m,artingale. Then there exists a process A E V{0,t) with Aq = such that 
Ut = Gt,T{UT;A),\/t E {0, 1,2,...,T} i.e. U is a G{-; A) -martingale. 

In order to prove the above theorem, we need to introduce a sequence 
BSDEs of the following form: for n — 1, 2, 

< = G,T(C/T;n J] ([/,-<)+), 

0<s<t 

i.e. 

k^ut+ Yl /(^><>^r)- E i^:rMs+,+n ^ (t/.-<)+. (6.6) 

t<s<T t<s<T t<s<T 

which has the following useful property. 

Lemma 6.8. For each n — 1,2, we have f Ut, dt x dP-a.e.. 
Proof. Considering the "one step" BSDEs as follows: 

< = Ut+, + n{Ut - <)+ + /«, 4) - {z^rMt+,, n E Z+ . (6.7) 
After taking conditional expectation for (6.7), we get 

< = E[U,^,\Tt] + n{U, - <)+ + /«, z'D^n E Z+ . 

It follows that 
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By martingale representation theorem [12] , there exists a unique Zt such 
that the above equation is satisfied for an arbitrary n. Then the equation 
(6.7) can be rewritten as follows: 

< = f/i+i + nilJt - <)+ + /«, Z,) - Z;Mi+i, n G Z+. (6.8) 

On the set {Ut < u^}, the equation (6.8) becomes = Ut+i + f {u^ , Zt) — 
Z^Mt+i , then we have 

< = i?[f/,+i + /«,Z,)|J-,] 
<Ut. 

which is a contradiction. So it is true that < Ut, dt x dP-a.e.. 

By Comparison Theorem 4.1, it is easy to verify that ul < uf < ... < Ut- 
Similar to the discussion of in theorem 4.3, we also have that m" is 
essentially bounded, consequently n{Ut — m")"*" is also essentially bounded 
for an arbitrary n. Let n — )■ oo, we have t Ut, dt x dP-a.e.. □ 

Proof of Theorem 6.7. We only need show that the theorem is true 
when T = t + 1 by the existence and uniqueness theorem. Define At := 
nJ2o<s<t(Us — W^)^ = '^X]o<s<t(^s '^'s)^ which is predictable and essen- 
tially bounded for an arbitrary n, and non- decreasing in t. Then has the 
following expression 

< = Ut+i + Ar+i -A^t+ /«, Zt) - Z;Mt+^, n e Z+. (6.9) 

We rewrite (6.6) in the following forward version: 

u^ = u-,-A^-J2 Zt) - J2 Z;Mt+,,n e Z+. 

0<s<t 0<s<t 

It follows that 

A- = -< + «s - E - E ^ e z+. 

0<s<t 0<s<t 
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Let n — )■ oo and by lemma 6.8, we have A" is convergent. Denote 

At := lim^^oo Af. 

Let n oo, then (6.9) becomes 

Ut = Ut+i + A+i -At + fiUt, Zt) - Z^Mt+i, n e Z+. 



Which means Ut — Gt,t+i{Ut+i', A), consequently the result is true. 

Remark 6.9. This theorem can be applied in finance that a g- super-martingale 
U can be equivalent to the dynamical evaluation of the sum of an increas- 
ing process A and the "final payoff" by one step method, where A can be 
dividend or consumption process. 

6.2 Optional Sampling Theorem for Gc7,t( ) 

We now consider the situation where the times s and t in Gs,ti-) is 
replaced by stopping times < a,T < T instead of deterministic times s 
and t. We shall develop a generalization version of the optional sampling 
theorem for g-super and g-sub-martingale in our framework. Firstly, we will 
define Go-,r(-)- 

For a given U E S'^, we can solve the following BSDE step by step 

uAt<u<t a/\T<u<T 

Then define G^^^iU) := 

Lemma 6.10. Let r be stopping times take values on {0, 1, ...,T} and {Ut) 
be a g- super-martingale. Then for each t G {0, 1, ...,T}, we have 

GtAUr)<UrAt:P-a.S.. (6.10) 

Proof. We first consider the case where t > T—1. Note that r = t1{t-<t-i}+ 
T1^T-=T} and the fact that l{T<r-i} and l{T=r} are J^t-adapted. 
Applying Corollary 6.4(4), we have 

Gt,T{Ur) = Gt,T{UTl{r=T} + Url{T<T-l}) 
= l{T=T}Gt,T{UT) + Url{T<T-l} 
< l{r=T}Ut + UtI{t<T-1} = UrAt- 
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Particularly, we have Gr-i^riUr) < f/rA(T-i)- Since r A i is valued in 
{0, 1, we can repeatedly use the above result to check the case where 

t = i, i < T — 1, i.e. 

^ UtAi = UrAt, 

which complete the proof. □ 

In (6.10), we replace the time t by a stopping time a, we have the 
following more general proposition. 

Proposition 6.11. Let r and a he stopping times take values on {0, 1, T} 
and {Ut) he a g-super-martingale. Then for each t G {0, 1, ...,T}, we have 

Proof. From (6.10), we have 

T T 

Ga,T{Ur) = ^ G'i^^(?7^)l{^=j} < ^(f/TAj)l{(T=j} = UrAa- 
i=0 i=0 

□ 

From proposition 6.11, we also have the following Optional Sampling 
Theorem for g-martingale in our framework. 

Theorem 6.12. (Optional Sampling Theorem) Let r and a he stopping 
times take values on {0, 1, T} such that a < t and (Ut) he a g-martingale 
(resp. g-super-martingale, g-suh-marting ale). Then for eacht & {0, 1,...,T}, 
we have 

G.^Ur) = U^resp. < U^, >U^),P- a.s.. 

6.3 Applications to multiple prior martingale under 
Knightian uncertainty 

It is possible to discuss more details about g-martingale and g-expectation 
as in [T7], but we will not develop this point here. We now focus our atten- 
tion on the theory of g-martingale under a multiple prior framework. 
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In order to solve the Knightian uncertainty problem in the sense that the 
distribution considered is not exactly known, Frank Riedel [21] developed a 
theory of optimal stopping along the classical lines extending suitable results 
from usual martingale theory to the nonlinear multiple prior expectation 
operator, which works as long as the set of priors is time consistent. The 
method can be used in the fields of Microeconomics, Operations Research 
and Finance and so on. He defined the multiple prior martingale (Ut) if it 
satisfies 

Ut = ess ini EP[Ut+i\Ttl 
pgA 

where A is the set of time-consistent priors, but we can not solve the 
essential infimum easily. In this subsection, we will transfer this computing 
problem into solving a kind of BSDE, which can be solved by some numerical 
methods. In [13], Li et al. discussed how to use BSDE based on Brownian 
Motion to compute one kind of the minimum expectation based on [3] , and 
now we want to study the connection between minimum expectation and 
g-expectation in our framework. 

We denote by Q the set of all probability measures Q ^ P. For any 
Q G Q, let Wt := E[^\J^t], then Wt is a martingale and by Martingale 
Representation Theorem in [H], there exists an adapted process z such that 
Wt = l + Eo<s<t^sM,^,. 

Let 9t:=§-^, then Wt = UoKsKti'^ + OsM^+i), and so 

^=wt= n (i+^^^^+i). (6-11) 

o<s<r 

which means there exists an adapted process {6t} such that ^ can be 
generated by (6.11) for any Q E Q. We denote by the probability 
measure generated by {Ot}. To guarantee the multiple prior martingale is 
well-defined, we shall consider the following probability measure set B: 

B = {Q^ E Q : the adapted process{^j}generating(5^satisfies sup \9t\ < k}, 

Q<t<T 

(6.12) 

where /c > is a given constant. 
Definition 6.13. Suppose ^ G S'^ , let 

G{0 ■= k^UEgm-, G{^\J^t) := essmf{EQ[^\J^t]},0< t < T. 
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Then we call G{^) and G{^\J-'t) minimum expectation and minimal condi- 
tional expectation respectively of ^ about B. Similarly, we can define the 
corresponding maximum expectation and minimal conditional expectation 
respectively. 

Remark 6.14. For any Q G B, ^ is essentially bounded because Mt is 
essentially bounded and (6.13), we have Eq[^] < oo, so the Definition 6.13 
is well defined. 

Next we will give the main results of this section. Suppose G 5"^, k be 
the constant in (6.13), and {yt, Zt) be the solution of the following BSDE: 

yt = i- Yl ^l^^l - Yl <^^+i'0 < t < T- (6.13) 

t<s<T t<s<T 

Or equivalently, 

Vt = Vt+i - k\zt\ - z*Mt+i,yT = ^,0 <t <T. 

Then we have the following connection between minimum expectation 
and g-expectation. 

Theorem 6.15. Under (H4), suppose ^ G , k is the constant in (6.13), 
Mt+i = Xt+i — E[Xt+i\J^t] where f ar(Xt_|_i|J^() = 1. Then we have 

where G^^{ ) denotes the corresponding solution of BSDE generated by 
fit,y,z)"= -k\z\ andvar{Xt+,\Tt) ■= E[Xl,\Tt] - {E[Xt+i\Tt]f . 

Proof. For a given C, G , by the existence and uniqueness theorem in [S], 
we know BSDE (6.13) has a unique solution {yt,Zt). Let = —ksgnzs, 
then (6.13) can be rewritten as 

yt = ^- Y KMs+i,o<t<T, 

t<s<T 

where Mg+i = Mg+i — a^. 

In our framework, we can divide the equation into many "one step" 
equations, so we only need consider the times t and t + 1, i.e. 

Vt = Vt+i - z*Mt+uyT = ^, < t < T, 
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In this case, suppose is the probabihty measure generated by {at}. 
Define ^^Ij-^^^ := 1 + atMt+i as the corresponding "one step" Radon- 
Nikodym derivative from t to t + 1. We can show that Mf+i is a martingale 
difference process under as follows. 

= Xt+i - ^[Xi+i| J-i)] - atE[Xt+i{Xt+i - E[Xt+i\J^t)Wt\ 
= Xt+i - EiXt+ilJ't)] -at^ Mt+i. 

Thus, 

EQa[Mt+,\J^^] = 0. 

Consequently, EQa[zt Mt+i\J-'t] = 0. 
So we have = £'Qa[|/j+i| j;] > ess inf gee ^gbt+i I ^t]- 
On the other hand, suppose e B which is generated by {Ot}. Then 
consider the following linear BSDE: 

y! = ^- Yl ^^^^ - E ^*sMs+i, 0<t<T. (6.14) 

t<s<T t<s<T 

Or equivalently, we have 

t/f = yl, - Otzt - z;Mt+^, y'T^C,0<t<T. (6.15) 

Similarly to the above method, we solve the above equation by "one 
step" method and obtain yf = EQe[y1_^-^\J-'t\. Moreover, note that —6tZ > 
— k\z\,W{z,t) G i?™ X {0, 1, ...,T}. Using the Comparison Theorem to equa- 
tions (6.13) and (6.14), we have 

yt > vt- 

Thus by the Existence and Uniqueness Theorem and (6.15), we have 

EQe[yl,\J^t] = EQe[^\J^t]>yt. 



29 



Then we obtain 

ess M^EQ[yt+i\Tt] > Vt- 

Which means yt = ess inf^gg i?Q[^| J^J. Especially, let t = 0, we have 
yo = essmfQ^sEgl^] i.e. G(0 = G,^UO,Gi^\Tt) = G'^iO- □ 

Corollary 6.16. The condition var{Xt^i\J^t) = 1 in theorem 6.15 guaran- 
tees that Mt is also a martingale difference process. There are many pro- 
cesses satisfying this condition, such as standard random walk and standard 
basis vector. 

Remark 6.17. // we want to know whether an adapted stochastic process 
(Ut) is a multiple prior martingale, we just need compute G'i^^_^_i{Ut+i) and 
verify the equality Ut = G~[^j^i{Ut+i) . The theorem 6.15 then gives us a 
method to compute the multiple prior martingale. 

6.4 Applications to optimal stopping problems in a 
multiple prior framework 

Actually, Riedel [2T] considered the optimal stopping problem under 
ambiguity for ambiguity-averse agents. This problem can be formulated as 
follows: 

maximize inf E^U^ over all stopping times r <T 

for a finite horizon T < oo, where C is the set of priors, {UtjteN is an 
essentially bounded and adapted process. 

To solve the above problem, Riedel [2T] studied a complete solution using 
the multiple prior Snell envelope U defined by Ut = Ut and 

Ut = max{Xi,ess inf E^[f/t+i|J-i]},t G {0, 1, T - 1}. 

Moreover, Riedel claimed that this approach works as long as C is time- 
consistent which can ensure that the prior constructed in some way belongs 
to the original set of priors. A more challenging work is how we can obtain 
the multiple prior envelope and solve it by numerical method. Motivated 
by the method of solving minimum expectation used in the last section. 
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we study the connection between a special kind of FS-RBSDEs and multi- 
ple prior envelope. Then the problem can be transformed into solving the 
corresponding FS-RBSDEs as follows: 

'lit = C7t+i - k\Zt\ - z;Mt+, + Kt+, - Kt 
Ut = Ut, Ut > Ut (6.16) 
{Ut-Ut){Kt+,-Kt)^0 

Thus, by Theorem 4.3, FS-RBSDEs (6.16) has a unique solution {Ut, Zt, Kt). 
Then we have the main results as follows. 

Actually, we can state that B is time-consistent as its own. 

Theorem 6.18. B is time- consistent. 

Proof. Suppose VQ" e be the probability measure generated by {at\. 

As in the proof of Theorem 6.15, we can define ^jp-\*j^^^^ := 1 + OtMt+i 
as the corresponding "one step" Radon-Nikodym derivative from t to t + l. 
Then 

^"^^ n (1 + = n '^^^ 



dP 11 ^ ' * 11 dP 

o<s<r o<s<r 



a 

s 

^3 + l'> 



k= n(i+««^"+i)= n o<t<s<T. 



and 

dQ^ 

11 V— -«--»^./ 11 

t<u<s t<u<s 

Thus, for VQ^ e B, let (pt) and (qt) be the density process of resp. 
with respect to P, i.e. 



Fix some stopping time r. Define a new probability measure R for 
< t < T as follows: 

dR Q _{pt if < i < T 
Ip'-^* ~ 1 2^ else 

The task is now to verify that it! belongs to B as well. The proof falls 
naturally into two cases: 
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(1) If t < T, the result is obviously true; 

(2) If else, we have 



dR 
dP 



0<U<T T<U<t 



Define q = (oq, ai, a^_i, 6^, then supo<t<T \ct\ < k. 

Thus, we have Re B. □ 

Theorem 6.19. Under Assumption (HA), suppose Ut £ , k is the con- 
stant in (6.13), and Mt+i = Xt+i — E[Xt+i\J-'t] where var{Xt+i\J-'t) = 1. 
Then the solution Ut of FS-RBSDEs is the multiple prior Snell envelope of 
U. 

Proof. By Proposition (5.3), we know Ut = Ut^ {—k\Zt\-\- E'\Ut+i\^^) where 
Z;Mt+i = IJt+i - E[Ut+i\J^t]- Then consider the following BSDE: 

Vt = IJt+i -k\zt\- z*Mt+i. 

It follows that Ut = -k\zt\+E[Ut+i\J^t], where z^Mt+i = Ut+i-E[Ut+i\J^t]- 
Then by Assumption (if4), we have Zt = Zt P-a.s. i.e. yt = —k\Zt\ + 
Ept^AJ't]. 

Moreover, by Theorem 6.15, we have yt — essvaip^Q E^\^t+l\^^■ 
'T:\ius, we have 



Ut = Uty {essird^E''[Ut+i\Ft 



□ 



Naturally, by the above theorem and Proposition 2.5 as well as some 
properties of FS-RBSDEs, we can obtain the following useful results: 

(z) f7 is the smallest multiple prior super-martingale with respect to B 
that dominates f/, 

{a) U is the value process of the following optimal stopping problem 
under ambiguity, i.e. 

Ut — ess sup ess inf E^lU-j-lTt], 
reJt -PeB 

(Hi) an optimal stopping rule can be given by 
T* = mi{t >0:Ut = Ut}. 
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We will consider a simple example in the condition where the distribution 
is not exactly known. It has been discussed in [15J (see example 10.2.2) and 
[5] (see example 5.1). Here we reconsider this problem in our framework. 

Example 6.20. Suppose someone owns an asset, whose value process is 
governed as follows: 

>o = y >0, 

where 6, a are given, Mt is a martingale difference process generated 
by some 1-dimensional stochastic process X^, where var{Xt+i\Tt) = 1, i.e. 
Mt = Xf — ElXflJ-'t^i] and Mq = 0. It also satisfies Assumption {H4). For 
simplicity, we let the interest rate is and 6 > 0. 

We aim to find the optimal time t* G {0, 1, ...,T} to sell this asset. If 
there does not exist any uncertainty, the risk only comes from the martingale 
difference process. The problem can be formulated as follows: 



sup E[Yr] 
0<T<T 



From (6.17), we know 



E[Yt+,-Yt]=bE[Yt]. 

By Yq = y > 0, we have Yi > Yq > P-a.s.. Then by induction we get 
Yt+i >Yt>0 P-a.s.. So the optimal time is r* = T, which implies that the 
owner is better hold this asset until the time T. 

Now if there exists uncertainty in this problem, which can be represented 
by a family probability measures: 

0<t<T 

Where is a predictable process taking values in [—1, 1]. 
If this asset owner is a ambiguity averse decision maker, this model can 
be formulated as: 

sup infE^'fi;]. 

T&{0,1,...,T} " 
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By the above theory, we know this model can be transferred to solve the 
following DF-RBSDE: 

Ut = Ut+i - \Zt\ - ZlMt+i + Kt+i - Kt 
Ut = Yt, Ut > Yt 
{Ut-Yt){Kt+i-Kt) = 0. 

By the Proposition 2.5, we know t* = inf{t < n < T; Uu = Y^} and 
T* = T if tJu > Y^,t < u < T. 

7 Applications to American Contingent Claims 

In a complete market, it is well-known that the price of an American 
option corresponds to the solution of reflected BSDEs which are based on the 
Brownian motion in the continuous situation, where the information flow is 
generated by the Brownian motion Actually, the transactions occurred 
in the finance market are discrete though many researchers consider the 
problem in the continuous framework because of some conveniences. So it 
is challenging to explore the valuation problem of American option in the 
discrete time and finite state case, where the pricing of stock can be drived 
by some martingale difference process in stead of Brownian motion. Then 
the problem of pricing of American option can be attributed to the solutions 
of FS-RBSDEs based on {M„, < m < T} in the discrete time and finite 
state space which is not yet limited to the Brownian motion or random 
walk. In particular, Mt can be generated by a stock price process {St}, i.e. 
Mt = St-E[St\Tt-i] and Mo = 0. 

7.1 The model of pricing of American options in a 
dynamically complete market 

Throughout this section, we maintain the Assumption {H4) holds. For 
guarantee of dynamically complete market, we make the following standard 
assumptions: 

• The short rate r is a predictable and bounded process which is generally 
nonnegative. 

• The stock appreciation rates b = (6^, 6^, 6")* is a predictable and 
bounded process. 
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• The volatility matrix a = (o"*'^) is a predictable and bounded process 
which has full rank a.s for all t G {0, 1, T} and the corresponding inverse 
matrix is also a bounded process. 

• There exists a predictable and bounded process vector 9 named risk 
premium, such that 

bt — Tfl = CFtOti dt X dP — a.e.. 

where 1 is the vector whose every component is 1. 

We start with the classical setup for discrete time asset pricing: the 
basic securities consist of m + 1 assets {SI; < t < T,i = 0,1, m}, one 
of which is a non-risky asset with price process as follows: 

where rt is the interest rate. Other m risky asset (the stocks) are traded 
discretely, of which the price process SI for one share of iih stock is governed 
by the linear difference equation 

m 

SU,-Sl = Slibl + J2 ^t'K+iU = 1, m. 
i=i 

where Mj = {M^, M^, .... M™)* is a martingale difference sequence on R"^. 
Moreover, suppose the portfolio process is if = {Hq, Hi, Hm) which is 
self- financing. Then the value process V = {Vo,Vi, ...,Vt) can be formulated 
as follows: 

m m 

Vt = H^{t)S^t + Hi{t)Si = H^{t + + Hi{t + 1)^;. 

So 

m 

-Vt = Ho{t + l){Sl, - S^) + J2 m + 1){SI^, - SI) 

m m 

= nVt + Y m + i)Sl{bl -n + J2 '^t'^^Z+i) 
1=1 j=i 

^rtVt + 7r;at{Mt+, + et), (7.1) 

where ttj = (tt^, tt^^), tt^ = Hi{t)Sl. Note that the equation (7.1) satisfies 
the assumptions of the Existence and Uniqueness Theorem, so there exists 
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a unique solution (Vt, nt) which means any essentially bounded contingent 
claim is attainable in a dynamically consistent market. From (7.1), we can 
solve Vt easily. 

As is known, the European Option can be viewed as the non-negative 
contingent claim, and the pricing of European contingent claims can be 
formulated in terms of backward stochastic differential equations, even in 
a imperfect market, we also have the corresponding representation of the 
European contingent claims in our framework which is more realistic. 

In a finance market, whatever perfect or imperfect, suppose we only 
know the contingent claim ^ is attainable (or marketable), we want to 
know the value process V and the portfolio H, then we can use the following 
backward method. 

Because Vt = ^, we can firstly solve 

m 

^ = Ho{T)S'T + J2MT)Sir. 

1=1 

More again, notice that H is predictable, so we can obtain H{T); on the 
other hand, H is self-financing which means 

m 

Vt-1 = Ho{T)S't + H^{T)Si^.^. 
1=1 

Then we can get Vt-i- Now using the same backward method, we can 
solve Vo finally (see more details and examples in [19j . 

Let us consider the valuation problem of an American contingent claim 
{^(,0 < t < T}— the holder can exercise only once at any time between 
{0,1,. ..,T} and anyone's actions can not affect market prices. The key 
problem is to determine value Vt of this option, that is, the value process 
V = {Vt] t = 0,1, ■ ■ ■ T}. As is known, this kind of claim can not be hedged 
by a general self-financing portfolio, and so it is necessary to introduce 
self-financing super-strategies with a cumulative consumption process. 

Definition 7.1. A self-financing super- strategy is a vector process {V, it, C), 
where V is the market value (or wealth process) ,7i is the portfolio process 
which is bounded, and C is the cumulative consumption process, such that 

Vt+, -Vt = rtVt + T^latiOt + M^+i] - (Q+i - Ct), 

where C is an increasing, right- continuous, adapted process with Co = 0. 
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Given a payoff process {Ct',t G {0, 1, ■■■,T}, a super-strategy is called a 
super-hedging strategy if there holds 

Vt>^t,te{0,l,...,T},P-a.s.. 

The smallest endowment to finance a super-hedging strategy is the price 
of the American option which could be greater than the price of for any 
stopping time t <T. 

According to the Existence and Uniqueness Theorem of FS-RBSDEs, 
we can prove the existence of a minimal essentially bounded super-hedging 
strategy associated with an essentially bounded payoff. 

Theorem 7.2. In a dynamically consistent complete market, consider an 
essentially bounded payoff process ^ with limt^TCt < ^T,ci-s.. The Ameri- 
can price process Y is associated with an essentially bounded super-hedging 
strategy, that is there exists a unique essentially bounded process (0, K) such 
that fort e {0, 1,...,T}, 

y^+i - = rtYt + <t>*at[et + M,+i] - - Kt). 

Moreover K satisfies the minimality condition ^o<t<T(-^ ~ ~ 
Kt) = 0. 

The American price is also the maximum X* of the European price pro- 
cess associated with an exercise at the stopping time r before T, that is 

Yt = = ess sup Xt{T, Ct)- 

reJt 

The stopping time Df = inf < s < T,Ys = ^g} is optimal, that is 
Yf — Xt{Dt, ^Dt)) where Xt{T, ^r) denote the European price at t dominated 
by T and the terminal value is . 

Proof. The existence and uniqueness follows from Theorem 4.3. 

Moreover, given a stopping time t E {t,t -\- 1, ...,T}, let us consider a 
super-hedging strategy (Y, 0, K) and calculate the variation of Y between t 
and r. 

Yt = E[- J2 i^sYs + (0.) V,) +Yr + Kr- Kt\Tt] 

t<S<T 

= E[- J2 i^sYs + (0.) V,) + CrlJ't]. 

t<S<T 
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By Comparison Theorem on {t,t + 1, T}, Y dominates the price pro- 
cess for the contingent claim with exercise at time r, X{t,^t-)- Hence, 



Yt > X* = ess sup Xt{T, ^r)- 

TGJt 

On the other hand, we can choose an optimal elementary stopping time 
in order to get the reversed inequality. Define 

A = inf{t <s<T;n = ej. 

and Dt = T if Yu> Su,t <u <T. 

Similar to the discussion in Proposition 2.5 and by uniqueness of BSDEs, 
for s e {t, t + 1, Dt}, we have 

Ys^E[- J2 iruYu + i<f>uT<Tu)+YD, + KD,-K,\Ts] 

s<u<Dt 

^E[- {ruYu+{(t>ur'Ju) + YD^\T,] 

s<u<Dt 

< ess sup E[- ^ (r„y„ + (0u)*(7„) + ^A{t<t} + ^T'i-{T=T}\J^s\- 

s<u<Dt 

Then the result follows immediately. □ 

In particular, Mt can be generated by a stock price process {St}, i.e. 
Mt — St — E[St\J^t-i] and Mq = 0. In this case, we will give a detailed 
example to show the pricing model of the European Option in a dynamically 
consistent complete market. 

Example 7.3. For simplicity, suppose T — 1, m — 1, — {uJi,U2}, r = 0, 
and Y^ is the wealth process of non-risky asset. Then Mi = 5*1— -^[S'llJ-'o] = 
AS — E[AS\J-'o\ and Mq = 0, where AS = Si — Sq. Suppose we have Yi = ^ 
given by 



6, CO — cui 

8, U! — U!2- 



Moreover, we have the stock price as follows: 



38 





t = 


t = 1 




So = 5 




0J2 


So = 5 


Si = 6 



Then the pricing model is given by 

Y — 

Yi^Yo + AY^Yo+ " 



Yo + 



So 

Yo-Y^ 



So 



AS 

{Mi + E[AS\J^o]) 



^Yo + ZoMi + ZoE[Si - SolJ'o]- 

where Zo = , which is the shares of the stock at time 0. 



It follows that 



Yo^Yi- ZoMi - ZoE[Si - SolJ'o]- 



(7.2) 



The risk neutral probability is Q — (1/2,1/2), under which we have 
Eq[Si - So\J^o] = 0, and 



Mi(cu) 



-1, UJ — UJi 
1, UJ^UJ2. 



Then (7.2) becomes 



Yo = Yi- ZoMi. 



Taking conditional expectation for (7.3) gives 

Yo^Eq[Yi\To\^Eq[C\To\^7 

-1, UJ — UJi 



ZoMi = Yi-Yo 



UJ — 002- 



Then Zo — 1, which gives Y^ = 2. Thus, the portfolio is (2, 7). 

Next, we will consider the valuation problem of an American contingent 
claim {^t} in the following example in a dynamically consistent complete 
market. 
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Example 7.4. Suppose the conditions in Example 7.4 also hold here. Given 
a process {'do,''9i} cls follows: -do — 1, and 



^1 = 



5, u — Ui 
7, a; = U2. 



By Theorem 7.3, there exists a unique essentially bounded process {(p, K) 
such that 

= ^1 - ^oMi - Z^E[S^ - 5o| Jo] + i^i - i^o, 
which can he rewritten as 

Yo^Y,-ZoM^ + K,-Ko. 



Moreover K satisfies the minimality condition {Yq — ^?o)(-^i — -^o) — 0. 
By the proof of Theorem 4-3, we have 



ZoM,^Y,-E[Yi\To\ 



— 1, CO = OJi 
1, U!=U!2. 



It also follows Zq = 1. And 

Yo = E[Yi\To\ +Ki-Ko^7 + K,-Ko. 



Then 

Yo-^o^G + Ki-Ko> Ki-Ko>0. (7.3) 

So we get Ki — Kq — 0. 

Then we have 10 = 7 and Y^ = 2. 

Otherwise, if we let -do — 8, then (7.3) can be rewritten as 
0<Yo-^o^-l + Ki-Ko<Ki- Ko. 



More again by the minimality condition, we have Yq = i^q = 8. 
Actually, the method used in above method is corresponding to Remark 
5.2. 
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7.2 The model of pricing of American Options in an 
incomplete market 

If American Options are considered in an incomplete market, there is 
more than one equivalent martingale measure, and then we have to face with 
the multiple prior set; alternatively, some people may want to assess the risk 
of an option by studying the optimal stopping problems under coherent risk 
measures, they again have a multiple prior setting. In this case, people want 
to know the minimum and maximum price of the option, i.e. minimum and 
maximum conditional expectation in mathematical terminology. 

Considering an investor who exercises an American Option that pays 
off Uf = F{t, St) when exercised at time t, we aim to solve the following 
problem: 

maximize inf E^U-r over all stoping times < r < T. 
PeB 

\\\ Theorem 6.19, we can solve a special kind FS-BSDE to obtain the 
multiple prior Snell envelope of U, which is the desired solution. 
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